Quality of Service Guarantee for Cluster-Based Internet Service

As Web-based interaction and transaction become an indispensable element of everyday corporate and commerce activity, Internet service providers are increasingly pressured by their customers to provide the capability of guaranteeing a certain level of quality in the Internet service they offer. In this work we propose a general implementation framework to provide quality of service (QoS) guarantee for cluster-based Internet service that is largely independent of the service application and the hardware/platform of the cluster. This thesis describes the design, implementation, and evaluation of a Web request distribution system called Gage, which is able to provide a performance guarantee, in the form of a certain number of generic Web requests per second, for every pre-specified class of Web accesses. The front-end request distribution server of Gage distributes incoming requests among a cluster of Web server nodes in a way that takes into account file cache affinity, load balancing, and quality of service (QoS) guarantee. Each Web server node includes a back-end service module of Gage, which performs distributed TCP splicing and detailed resource usage accounting. The first Gage prototype shows that it can indeed provide a guaranteed level of service for classes of Web accesses according to their pre-specified QoS requirements in the presence of excessive input loads. In addition, performance measurement on the Gage prototype demonstrates that the additional scheduling and accounting overheads associated with Gage’s support for Web access QoS guarantees is only under 5.2%. Index ,QWURGXFWLRQ ...................................................................................................... 4 5HODWHG :RUN .................................................................................................... 6 'LIIHUHQWLDWHG 4R6.............................................................................. 6 *XDUDQWHHG 4R6 .................................................................................. 7 3UREOHP 'LVFXVVLRQ .......................................................................................... 9 6HUYLFH 3URWRW\SH ............................................................................... 9 4R6 0HWULF 6HOHFWLRQ .......................................................................... 9 4R6 &RPSRQHWV ................................................................................. 10 7KH *DJH 6\VWHP............................................................................................ 13 6\VWHP $UFKLWHFWXUH ......................................................................... 13 'LVWULEXWHG 7&3 FRQQHFWLRQ VSOLFLQJ............................................... 15 5HTXHVW &ODVVLILFDWLRQ ...................................................................... 19 5HTXHVW 6FKHGXOLQJ .......................................................................... 20 5HVRXUFH 8VDJH $FFRXQWLQJ ............................................................. 22 6HUYLFH 6SHFLILF &RPSRQHQW............................................................ 24 &RPSDULVLRQ ZLWK 3UHYLRXV :RUN..................................................... 25 3HUIRUPDQFH (YDOXDWLRQ ................................................................................ 27 3URWRW\SH ,PSOHPHQWDWLRQ DQG 7HVW EHG 6HW XS ........................... 27 4R6 *XDUDQWHH XQGHU ([FHVVLYH ,QSXW /RDGV................................. 28 2YHUKHDG $QDO\VLV............................................................................. 30 6FDODELOLW\ .......................................................................................... 30 &RQFOXVLRQV DQG )XWXUH :RUN ....................................................................... 32 5HIHUHQFHV %LEOLRJUDSK\ ............................................................................... 33